Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder

The emergence of the new generation video coding standard, Versatile Video Coding (VVC), has brought along novel features rendering standard more efficient and flexible than its predecessors. Aside from compression 8 k or higher camera-captured content, VVC also supports a wide range applications, including computer-generated high dynamic (HDR) multilayer multi-view coding, region extraction, as well 360° video. One newly introduced tools in VVC, offering extraction independent rectangular sub-areas within frame, is called Subpicture. In this work, we turn our attention to frame partitioning using Subpictures particularly, content-aware considered. To achieve that, make use image segmentation algorithms properly modify them operate on per Tree Unit (CTU) basis order render compliant with standard’s restrictions. Additionally, since subpicture boundaries need comply slice boundaries, propose two methods for tiles/slices aiming avoid over-partitioning frame. proposed are evaluated regarding both efficiency effectiveness. Our evaluation results indicate that schemes have negligible impact quality